Benefit , Design And Evaluation Of Multimodal Interaction
نویسندگان
چکیده
In this paper we define our position regarding current research questions in the field of designing speech and multimodal interactions for mobile and wearable applications. Our argumentation is organized in three areas reflecting our following basic research questions questions: (1) what are the benefits that can emerge through multimodality, (2) how can these benefits be considered in the system design, and (3) how does multimodality affect the evaluation of HCI. We conclude that multimodality should be considered where the user has a benefit of it, that these benefits should be specifically supported by the interface design process, and that targeted use of multimodality should have positive impact on the evaluation results of HCI.
منابع مشابه
Using Ontologies in Design of Multimodal User Interfaces
In this paper we introduce an ontology-based approach to the design of multimodal user interfaces. The main benefit of our approach is the unified ontology of multimodal interaction, where we have integrated the knowledge and common concepts from different domains of multimodal interaction in a uniform way. The unified ontology of multimodal interaction can be viewed as a tool that a designer o...
متن کاملUsability framework for the design and evaluation of multimodal interaction
The design and evaluation of multimodal interaction is difficult. For designers in industry, developing multimodal interaction systems is a big challenge. Although past researches have presented various methodologies, they have addressed only specific cases of multimodality and failed to generalise their methodologies to a range of applications. In this paper, we present a usability framework f...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملEvaluating tangible objects for multimodal interaction design
The design of applications with multimodal interfaces currently implies complex handcrafting by interface experts, lack of compliance with industry standards of cost effectiveness, maintenance and user focus such as those achieved by the current User-Centered Design methods. This paper presents an initial step towards a design by-example approach, whereby the end-user’s multimodal preferences f...
متن کاملEvaluation of multimodal dialog systems
This paper presents the results of an elaborate study on pen and speech-based multimodal interaction systems. The performance o f the “COM IC” system is assessed through human factors analyses and evaluation o f the acquired multimodal data. The latter requires tools that are able to m onitor user input, system feedback, and performance of the multimodal system components. Such tools can bridge...
متن کامل